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Abstract 

In this paper we estimate the rest of the approximation of a stationary process by a martingale 
in terms of the projections of partial sums. Then, based on this estimate, we obtain almost sure 
approximation of partial sums by a martingale with stationary differences. The results are exploited 
to further investigate the central limit theorem and its invariance principle started at a point, as well 
as the law of the iterated logarithm via almost sure approximation with a Brownian motion, improving 
the results available in the literature. The conditions are well suited for a variety of examples; they 
are easy to verify, for instance, for linear processes and functions of Bernoulli shifts. 
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1 Introduction and notations 

In recent years there has been an intense effort towards a better understanding of the structure and 
asymptotic behavior of stochastic processes. For processes with short memory there are two basic 
techniques: approximation with independent random variables or with martingales. Each of these 
methods have its own strength. On one hand the classes that can be treated by coupling with an 
independent sequence exhibit faster rates of convergence in various limit theorems; on the other hand 
the class of processes that can be treated by a martingale approximation is larger. There are plenty 
of processes that benefit from approximation with a martingale. Examples are: linear processes with 
martingale innovations, functions of linear processes, reversible Markov chains, normal Markov chains, 
various dynamic systems, discrete Fourier transform of general stationary sequences. A martingale 
approximation provides important information about these structures, and since martingales can 
be embedded into Brownian motion, they satisfy the functional central limit theorem started at a 
point, and the law of the iterated logarithm. Moreover, martingale approximation provides a simple 
and unified approach to asymptotic results for many dependence structures. For all these reasons, 
in recent years martingale approximation, " coupling with a martingale" , has gained a prominent 
role in analyzing dependent data. This is also due to important developments by Liverani (1996), 
Maxwell and Woodroofe (2000), Derriennic and Lin (2001 a), Wu and Woodroofe (2004) and recent 
developments by Peligrad and Utev (2005), Peligrad, Utev and Wu (2007), Merlevede and Peligrad 
(2006), Pehgrad and Wu (2010) among others. Many of these new results, originally designed for 



^Supported in part by a Charles Phelps Taft Memorial Fund grant and a NSA grant. 



1 



Markov operators, (see Kipnis and Varadhan, 1986; Derriennic and Lin, 2007, for a survey) have 
made their way into Hmit theorems for stochastic processes. 

So far this method has been shown to be well suited to transport from the martingale to the 
stationary process either the conditional central limit theorem or conditional invariancc principle in 
mean. As a matter of fact, papers by Dedecker-Merlevede-Volny (2006), Volny (2007), Zhao and 
Woodroofc (2007 a), Gordin and Pcligrad (2010), obtain characterizations of stochastic processes 
that can be approximated by martingales in quadratic mean. These results are useful for treating 
evolutions in "annealed" media. 

In this paper wo address the question of almost sure approximation of partial sums by a martingale. 
These results are useful for obtaining almost sure limit theorems for dependent sequences and also 
limit theorems started at a point. Limit theorems for stochastic processes that do not start from 
equilibrium is timely and motivated by evolutions in quenched random environment. Moreover recent 
discoveries by Volny and Woodroofe (2010) show that many of the central limit theorems satisfied by 
classes of stochastic processes in equilibrium, fail to hold when the processes are started from a point, 
so, new sharp sufficient conditions should be pointed out for the validity of these types of results. 
Recent steps in this direction are papers by Zhao and Woodroofe (2007 b), Cuny (2009 a and b), 
Cuny and Peligrad (2009). 

The technical challenge is to estimate the rest of approximation of partial sums by a martingale 
which leads to almost sure results, ranging from the almost sure central limit theorems started at a 
point, almost sure approximation with a Brownian motion and the law of the iterated logarithm. 

We shall develop our results in the framework of stationary processes that can be introduced in 
several equivalent ways. 

We assume that (^„)„gz denotes a stationary Markov chain defined on a probability space {Cl, P) 
with values in a measurable space. The marginal distribution and the transition kernel are denoted 
by 7r(A) = P(^o e A) and QHq.A) = P(^i e A|^o)- Next let L^(7r) be the set of functions on S such 

n-l 

that / pd-K < oo and / fdn = 0, and for a / eLo(7r) denote Xi = /(^j) , Sn = J2 (i-^- '^'i = -''^o, 

i=0 

^2 = Xo+Xi, ...). In addition Q denotes the operator on L2(7r) acting via {Qf){x) = jg f{s)Q{x, ds). 
Denote by J^k the cr-field generated by with i < k. For any integrable variable X we denote 
EkiX) = E(X|J-fc). In our notation Eo(Xi) = Qf{^o) = H^il^o)- 

Notice that any stationary sequence {Xk)kei. can be viewed as a function of a Markov process 
= {Xi;i < k), for the function g{£,k) = Xk- 

The stationary stochastic processes may also be introduced in the following alternative way. Let 
T : O i-> be a bijective bi-measurable transformation preserving the probability. Let J^o be a 
fj-algcbra of J" satisfying Jq C T~^{J^o)- We then define the nondecreasing filtration {J^i)i^i, by 
J^i = r^'(J"o)- Let Xq be a random variable which is J^o-measurable. We define the stationary 
sequence (Xj)jez by Xi = Xq o T\ 

In this paper we shall use both frameworks. The variable Xq will be assumed centered at its mean, 
i.e. E(Xo) = and square integrable E(Xq) < oo. 

The following notations will be frequently used. We denote by ||X|| the norm in L^(J1, J^, P), the 
space of square integrable functions. We shall also denote by \ \X\\p the norm in 1J'{^, J", P). For any 
two positive sequences a„ <C hn, means that for a certain numerical constant C. we have a,i < C6„ 
for all n; [a;] denotes the largest integer smaller or equal to x. For the law of the iterated logarithm 
we use the notation log2n = log(log(max(e, n))). The notation a.s. means almost surely, while 
denotes convergence in distribution. 

The main question addressed is to find sufficient projective conditions such that there is a martin- 
gale M„ with stationary differences such that either 

Sn-Mn = o{in}''^) a.s. , 
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or 

Sn - Mn = o(nlog2 n)^/^ a.s. 

These types of approximations are important to study for instance the hmit theorems stated at a 
point (quenched) and the law of the iterated logarithm via almost sure approximation with a Brownian 
motion. 

The "so called" quenched CLT, states that for any function / continuous and bounded 

Eo(/(^„/V^)) ^ nf{cN)) a.s. , (1) 

where iV is a standard normal variable and c is a certain positive constant. By the quenched invariance 
principle we understand that for any function / continuous and bounded on £'[0,1] endowed with 
uniform topology we have 

^oU{S[nt]/M) ^ niicW)) a.s. (2) 

where W is the standard Brownian measure. We shall also refer to these types of convergence also as 
almost sure convergence in distribution under Pq a.s., where Po(j4) = P(A|J"o)- 

This conditional form of the CLT is a stable type of convergence that makes possible the change 
of measure with a majorating measure, as discussed in Billingsley (1999), Rootzen (1976), and Hall 
and Heyde (1980). 

In the Markov chain setting the almost sure convergence in ([T]) or ([2]) are presented in a slightly 
different terminology. Denote by and the regular probability and conditional expectation given 
Xq — X. In this context the quenched CLT is known under the name of CLT started at a point i.e. 
the CLT or its functional form holds for tt— almost all x G S, under the measure P^. 

Here is a short history of the quenched CLT under projective criteria. A result in Borodin and 
Ibragimov (1994, Ch 4) states that if ||Eo(5'„)|| is bounded, then the CLT in its functional form started 
at a point holds. Later work by Derriennic and Lin (2001 b) improved on this result imposing the 
condition ||Eo(5'„)|| <C n^/^"*^ with e > (see also Rassoul-Agha and Seppalainen, 2008 and 2009). 
This condition was improved in Zhao and Woodroofe (2008-a) and further improved by Cuny (2009 
a) who imposed the condition ||Eo(5'„)|| n^/^(logn)~^(loglogn)~^~'' with S > 0. A result in Cuny 
and Peligrad (2009) shows that the condition Y^kLi l|Eo(^fc)||/fc^/^ < oo, is sufficient for ([J). 

We shall prove here that the condition imposed to ||Eo(S'„)|| can be improved, by requiring less 
restrictive conditions on the regularity of ||Eo(5'„)|| than the result in Cuny (2009 a). Then we shall 
point out that the condition can be further weaken if we are interested in a result for averages or if 
finite moments of order larger than 2 are available. 

To prove the law of the iterated logarithm we shall develop sufficient conditions for almost sure 
approximation with a Brownian motion; that is we shall redefine X„, without changing its distribution, 
on a richer probability space on which there exists a standard Brownian motion {W{t),t > 0) such 
that for a certain positive constant c > 0, 

Sn ~ W{cn) = o{n log^ nfl'^ a.s. (3) 

Our method of proof is based on martingale approximation that is valid under the Maxwell- Woodroofe 
condition: 

A(Xo) = f:«|^<oo. (4) 

k=\ 

The key tool in obtaining our results is the estimate of the rest of the martingale approximation in 
terms of ||Eo(5fc)||. We shall establish in Section 2 that there is a unique martingale with stationary 
and square integrable differences such that 
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^1/2 p/2 • V ) 

k>n 

We then further exploit the estimate ([5]) to derive almost sure martingale approximations of the 
types (HH) and dH]) in Section 3. 

Our paper is organized as follows: In Section 2 we present the martingale approximation and 
estimate its rest. In Section 3 we present the almost sure martingale approximation results. Section 
4 is dedicated to almost sure limiting results for the stationary processes. Section 5 points out some 
applications. Several results involving maximal inequalities and several technical lemmas are presented 
in the Appendix. 

2 Martingale approximation with rest 

Proposition 1 For any stationary sequence (Xfe)fegz and filtration {Tk)kei. described above with 
A{Xo) < oo, there is a martingale {Mk)k>i with stationary and square integrable differences {Dk)kei. 
adapted to {Tk+i)kei, = YJ^Za A, satisfying 

To prove this proposition we need two preparatory lemmas. It is convenient to use the notation 

yr = ^^k{Xk+i + ... + . (6) 

We shall also use the following semi- norm notation. For a stationary process {Xk)kei define the 
semi-norm 

||Xo||^=lim sup ^£(5^) . (7) 



n— ^-oo 



n 



Lemma 2 Assume ||yQ™||+ — > 0. Then, there is a martingale {Mk)k<£Z with stationary and square 
integrable differences adapted to {J-k+i)kez satisfying 

||5„-M„|| ||IE(5/|J-o)|| 



, < max h V + 



n 

Proof. The construction of the martingale decomposition is based on averages. It was introduced 
by Wu and Woodroofe (2004; see their definition 6 on the page 1677) and further developed in Zhao 
and Woodroofe (2008 b), extending the construction in Heyde (1974) and Gordin and Lifshitz (1981); 
see also Theorem 8.1 in Borodin and Ibragimov (1994), and Kipnis and Varadhan (1986). We give 
the martingale construction with the estimation of the rest. 

We introduce a parameter m > 1 (kept fixed for the moment), and define the stationary sequence 
of random variables: 



m 

i—l 



n-1 



0^ = 1veo(5.), e^^e^oT'^ . 

Set 

fe=0 

Then, {D™)kez is a stationary martingale difference, 13™ is JTj+i-measurable and sequence and 
(M™)n>o is a martingale. So we have 

^k = -D™ + ~ ^fc+i + — Efc(5'fc+„i+i - Sk+i) 
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and therefore 



Sk = Mr + 0^ - 0™ + 1e,_i (5,+,„ - S,) (9) 

— '7=1 m 



3=1 m 

where we implemented the notation 

,fc 1 



J — ^ III 



Observe that 

With the notation 
we have 
Notice that 



k~l 

Rr = T.^r- (10) 

S, = Mr + RT ■ (12) 
ll^n - M^ll < 3 max \mS.,\To)\\ . (13) 

l<2<n 

It was shown in Gordin and Pehgrad (2009) that if ||l^o™ll+ ^ then Dq converges in L2 to a 
martingale difference we shall denote by Dq. Moreover sup]^<;<„j ||E(5i|Jx))|P/'Ti — > 0. Denote Di the 
limit of Z?" and construct the martingale M„ = X) J=o ■ 

Let n and m be two strictly positive integers. By the fact that both Dq and are martingale 
differences and using (fTTj) and ([T2l) we deduce 

1 1 /Vf " _ A/f ™ I P 1 

11^0 - D^oW - " " ^ < -11(^0 - c + rZ) - (c - c + oir 



So for n fixed, by the fact that sup]^<;<,„ ||E(S'/|J-o)|P/m — > we have that 

1 

m— i-oo rn 

We continue the estimate in the following way 



- DoW = Jim^^ \\D- - Dl^W < Jm^ z:jj^\\Rj\ = ll>^o"ll+ • (14) 



n n 

lie 71 ,rn 1 1 2 

<2( ii^" +iiijg-i^oin 



n 

The lemma follows by combining the estimates in (fT3| and (fT4|) . 

Next we estimate 1 1 Yg" 1 1 + . 
Lemma 3 Under the conditions of Proposition]^ for every n > 1 and any m> 1, we have 

' ■■maxlgmiK E (15) 



-■ '- fc=0 k=m+l 



and 

11^0 11+ « 2^ ^.3/2 ■ (16) 



/c3/2 

A:>m 
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Proof. In order to prove this inequality, we apply the maximal inequality in Peligrad and Utev 
(2005) to the stationary sequence Fg™ defined by where m < n. Then, 

i-i 

II max l^rri ||«ni/2(||r^"|| + A(y™)) . 

l<7<n ^ — ^ 

We estimate now A(Fq^). It is convenient to use the decomposition 

oo ^ 

A(Fo'") = E fc372 iiiEo(^o" + - + ykii)\\ < 

m ^ oo 

Y.^moiY^ + -+Ykii)\\+ E ^iiw + - + n"i)ii- 

k—l A:— m+1 

To estimate the first sum notice that, by the properties of conditional expectation, we have 

||Eo(yo™ + ... + n:!!i)||<fc||Eo(rj")||, 

and then, since ||Eo(yo")|| < ||Eo(S'™)||/m we have 

E ^WMYo- + ... + rr_,)ii < ^ E « ;^iiEo(5„)ii . 

fe=l k=l 

To estimate the second sum we also apply the properties of conditional expectation and write this 
time 

||EoW + ... + i"/c-i)ll<l|Eo(50ll . 

Then, 

E ^iiw^ + - + >^r-r)ii< E 

k—m-^l fc— m+1 

and overaU, for a certain positive constant C, 



^(^o")<C(;;i7,||Eo(^„0||+ E 

k—m-\-l 



k—m-\-l 

We conclude that for any strictly positive integers n and m we have 



^ fc=0 fe=m+l 



The estimate (jlSp of this lemma follows now by using Lemma [T71 from the Appendix with p = 2 and 
7 = 1/2. With the notation (O, by passing to the limit in relation ([T5|). we obtain p^ . 

Proof of Proposition [1] 

Notice that (|4|) implies 11^0™!!+ ^ ^- Wc combine the estimate in Lemma [2] with the estimate of 
||yQ'"||+ in Lemma |3]to obtain the desired result, via Lemma [T71 in Appendix applied with p — 2 and 
7 = 1/2. 
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3 Almost sure martingale approximations 

In this section we use the estimate ([5]) obtained in Proposition [T] to approximate a partial sum by a 
martingale in the almost sure sense. 

Proposition 4 Assume (fen)n>i is any nondecreasing positive, slowly varying sequence such that 

E^(E^#^r<-. (17) 

n>l k>n 

Then, there is a martingale {Mk)k<£Z with stationary and square integrable differences adapted to 
{^k+i)kei satisfying 

a.s. (18) 



where b*^ := ELil^^fc)"^- 

As an immediate consequence of this proposition we formulate the following corollary: 

Corollary 5 Assume that for a certain sequence of positive numbers (&n)n>i that is slowly varying, 
nondecreasing and satisfies X]n>i('*^")~^ condition j j7| ) is satisfied. Then there is a martingale 

(-Mfe)fcez with stationary and square integrable differences adapted to {J^k+i)kez satisfying: 

„i/2 ^ (19) 

Example: In Corollary [5] the sequence (6„)„>3 can be taken for instance 6„ = (logn)(log2 n)^ 
for some 7 > 1. 

Selecting in Proposition 2] the sequence 6„ = logn, we obtain: 
Corollary 6 Assume that 

n>l k>n 

Then there is a martingale {Mk)kez with stationary and square integrable differences adapted to 
{,^k+i)kei satisfying: 

— -j^ -> a.s. 21 

[n log2 ny^ 

Proof of Proposition [4l 

By Corollary 4.2 in Cuny (2009 a), given in Appendix for the convenience of the reader (see 
Proposition [T9|). in order to show that 

Sn - M„ ^ 

> a.s. , 

we have to verify that 

|2 



„2 



n>l 

By Proposition [1] we know that 
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\\MSk)\\ 

„l/2 ^ 2^ p/2 • 

/c>n 

Therefore the condition (1171) impHes the desired martingale approximation. 



Remark. Notice that our condition pT)) is impHed by the condition in Corollary 5.8 in Cuny 
(2009 a). He assumed for the same results ||Eo(S'„)|| < n^^^{\ogn)-'^{log2)-'^-^ with S > 0, that 
clearly implies (fT7|) . Also ([20|) is implied by the result in Corollary 5.7 in Cuny (2009 a) who obtained 
the same result under the condition ||Eo(S'„)|| ^ n^/^(log n)~^(log2 n)""^ with r > 1/2. 

In the next two subsections we propose two ways to improve on the rate of convergence to of 
assure an almost sure martingale approximations in some sense. 



3.1 Averaging 

In the next proposition we study a Cezaro-type almost sure martingale approximation. 
Proposition 7 Assume that 

n>l k>n 

Then there is a martingale (Mk)kei- with stationary and square integrable differences adapted to 
(J"fc+i)fcez satisfying: 

-E^TT^^O-- (23) 

fe=i 

Before proving this proposition we shall formulate condition (|22p in an equivalent form that is due 
to monotonicity: 

Proof of Proposition[7l We notice that the condition ((22)) implies by Proposition[l]the existence 
of a martingale (M„)n>o with stationary differences such that 

Ells',! — M„|p 
-2 < «^ ' (25) 

n>l 

that further implies 

< oo a.s. 

n>l 

Whence, by Kronecker lemma, 

iv(^^^^Oa.s. 

n k 
fc=i 

and then, by Cauchy-Schwarz inequality 



l^fc-Mfcl ^ ^ ^(Sfe-Mfc)%i/2 

fci/2 -y^l^ 

k=l k=l 
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Therefore 

- > - — r-rT5 — - a.s. 

k=l 



This idea of considering the average approximation can be also apphed to Markov chains with 
normal operators (i.e. QQ* — Q*Q on L^(7r)). For this case we can replace our Proposition [1] by a 
result stated in Cuny (2009, a) for normal Markov chains namely, 



|g„-M„|p 1 ^ WEojSkW I WMSkW .26) 



Then we can replace in the proof of Proposition [7] our Proposition [T] by the inequality ([26| . 
Notice that 



n '•n '■ — ' fc ^ fc2 

n>l k<n k>\ 



and 

|Eo(^fc)||% V- logn||Eo(^„)||2 



n>l k>n n>\ 



< oo 



We can then formulate: 

Proposition 8 Given a stationary Markov chain (^„)ngz with Normal operator and Xi — f{£,i) is 
centered at mean and square integrable. If the condition 

^ logn||Eo(^„)|p 

n>2 

is satisfied, then \23l\) holds. 

We point out that condition (|27p by itself does not imply (ITS)) so the averaging is needed. As a 
matter of fact, Cuny and Peligrad (2009) commented that there is a stationary and ergodic normal 
Markov chain and a function / such that 

^ logrilog2HPEo(Mf / 

E -2 

n>2 

and such that fails. 
3.2 Higher moments 

Another way to improve on the rate of convergence to of ||E(5j|J"o)||/i^/^ in order to establish 
central limit theorems started at a point is to consider the existence of moments higher than 2. 

Proposition 9 Assume that for some 5 > Q, EjXoP^'' < oo, and that the condition is satisfied. 
Then, there is a martingale {M]^)]^(zz with stationary and square integrable differences adapted to 
(J"fe+i)fcez satisfying for every e > 

V n"^P(max IS*, - MA > ey^) < oo , 

— ' 7<n 



and therefore Sn — Mn — o{n^^^) a.s. 
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Proof of Proposition [9l Since, by assumption (1^^ it follows that J2j>i \-^o)\\ < oo, 

according to Proposition [1] there exists a martingale {Mk)k<£Z with stationary and square integrable 
differences {Dk)k£Z adapted to {J-k+i)kei. such that ^ is satisfied. Applying then Corollary [TBI with 
ip{x) = a;^, p = 2, Yi = Xi^i, Zi = Z?i_i and Qi = Fi, we get that for every e > and any a G [0, 1), 



max|^, -M,| > 4£V^) « 1 ( ^ ^||E(5, | J-o)||) ' + '^^{\Xo\l{\x„\>enU^-^}) (28) 



3>n 



£2 ( fc3/2 
fe>[n"] + l 



Choosing now a = S/{2 + 26), we get by using Fubini theorem that 

E TJH^ (l^0|l{|Xo|>e„V.- = j) « -^mo\'+' ■ (29) 



ni/2 

ri>l 



Therefore, starting from ^28\i and using (|29l) . we infer that the theorem holds provided that 

zii E «j?^r<=o. (30) 

">1 j>[„5/(2 + 25)] 

Now by the usual comparison between the series and the integrals, we notice that for any nonincreasing 
and positive function h onR+ and any positive a, X)n>i 'n~^h{n°') < oo if and only if X]ri>i n~^h(n) < 

oo. Applying this result with h{x) ~ (X]j>[x] ■^^^^jItt^) ; it follows that the conditions (|22|) and 
([30| are equivalent. This ends the proof of the theorem. 

Next proposition will be useful to transport from the martingale to the stationary sequence the 
law of iterated logarithm. Its proof follows the same line as of Proposition[9]with the obvious changes. 

Proposition 10 Assume that E|A'op+'' < oo for some S > 0, and that 

^1 ^M|l^2lf<»^ (31) 

^nlogon^ j3/2 V ^ 

n>3 °2 j>„ J 

Then there is a martingale (Mk)k£Z with stationary and square integrable differences adapted to 
(J-fc+i)fegz such that we have the approximation 5„ — A/„ — o(nlog2 n)^/^ ^ g_ 



We shall point now two sets of conditions that satisfy the conditions of these last two propositions. 
Assume that | |E(S'„| J"o)| I < ni/2(logn)-3/2(log2 n)^ for a certain /3 > 1/2. Then condition ([22]) is 
satisfied. If | |E(S'„| J'o)! | < ^^/^(log n)-3/2(log2 n)-^ for a 7 > then the condition dHJ) is satisfied. 



4 Quenched Central Limit Theorem and the Law of iterated 
Logarithm 

We shall formulate here a few applications of the almost sure martingale approximations to quenched 
functional CLT and LIL. For simplicity we assume in this section that the stationary sequence is 
ergodic to avoid random normalizers. 
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Theorem 11 Assume that the stationary sequence is ergodic and the conditions of Corollary \^ or 
Proposition hold. Then 

S[nt]/ Vtt- ^ ^i'^'^t) under Fq a.s. , 
where a = ||£>o|| and Dq is defined by 

Proof. The conditions of Coronary [5] or Proposition |9] imply that for every e > 

Po( max \Sk - Mfcl > eVn) ^ a.s. 

l<A:<n 

that further imphes 

Po( sup |S'[„t] - M[„t]| > eV^) ^ a.s. 

0<t<l 

According to Theorem 3.1 in BiUingsley (1999), the hmiting distribution of S[nt]\/V^ is the same as 
of M[nt]/\/n under Pq a.s. It was shown in Derriennic and Lin (2001, a) in details that 

M[nt]/Vn ^ W{a'^t) under Pq a.s. , 

and the result follows. 

Theorem 12 Assume that the stationary sequence is ergodic and the conditions of Proposition^ are 
satisfied. Then we have 

^E^^'^^^O,^) under ]Po a.s. , (32) 

k—l 

where a — ||i?o|| f"^*^ *s defined by (0). 

Proof. Under the condition (1^^ we know there is an ergodic martingale (M„) with stationary 
and square integrable differences (-Dn) satisfying 

l^\Sk~Mk\ ^ 

n ^ fci/2 
fe=i 

Then, by Theorem 3.1 in BiUingsley (1999), the limiting distribution of 

1 »^ ^ S 1 > A/ 

— / TTTT coincides to the limiting distribution of — > — -— under Pn a.s. 

k=l k=l 

By changing the order of summation we can rewrite X]fc=i Mk/k^^^ as 

n— 1 n -. 
i=0 fe=i+l 

and, according to the Raikov method for proving the central limit theorem for martingales, we have 
to study the limit of the sum of squares. Then, starting from 



- V ^ lE(-Do) = cr^ a.s. and in Li, 

1=0 

we easily conclude, by the generalized Toeplitz lemma (see Lemma I^Ul) that 

1 ""^ " 1 2 

i=0 fc=i+l 

Then, by Theorem 3.6 in Hall and Heyde (1980) we easily obtain the convergence in 
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Theorem 13 Assume that either the conditions of Corollary [5| or of Proposition [73 hold and in 
addition the sequence is ergodic. Then we can redefine (X„)„gz, without changing its distribution, on 
a richer probability space on which there exists a standard Brownian motion {W{t),t > 0) such that 



Therefore, the LIL holds: 



Sn - WinWDoW'') = o(nlog2n)i/2 a.s. 



S 

limsupifc " . = IlLioll a.s. 

(2n log2 n)^' ^ 



Proof. Since by Corollary IH] or by Proposition [TU] we have Sn — M„ = o(n log2 n)"'^/^ a.s. the 
result follows by the almost sure invariance principle for stationary and square integrable martingales 
(see Strassen, 1967). 



5 Applications 

We shall mention two examples for which the quantity | |-^o) I P is estimated. Then, these estimates 
introduced in our results will provide new asymptotic results started at a point and LIL, that improve 
the previous results in the literature. 

1. Application to linear processes. 

Let (en)nez be a sequence of ergodic martingale differences and consider the linear process 

Xk — ^ aiEk-i 

i>l 

where (ai)i>i is a sequence of real constants such that J2i>i < oo. We define 

n 

Sn = Xi . 
i=l 

Denote by 

bnj — 0,j+l + ■•• + flj+n ■ 

Then 

msniToW = ^2^1, . 

For the particular case a„ ^ l/{nL{n)), where L{-) is a positive, nondecreasing, slowly varying 
function, computations in Zhao and Woodroofe (2008-a) show that | |E(S'„| J^o)| I ^ ^/njL[n). 

2. Application to functions of Bernoulli shifts. 

Let (efc)fe£z be an i.i.d. sequence of Bernoulli variables, that is P(ei = 0) = 1/2 = P(ei = 1) and 

let 

Yn = ^2-'=-ie„_fc, Xn = g{Yn) - / g(x)dx, and = ^Xfe , 

fe=0 "^0 k=l 

where g G L2(0,l), (0,1) being equipped with the Lebesgue measure. The transform Yj is usually 
referred to as the Bernoulli shift of the i.i.d. sequence (efc)fegz- Then, following Maxwell and Woodroofe 
(2000), as in Peligrad et al (2007), 
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l|E(ff(>fc)|ro)||2<2W / I(\.-y\<2-^)\9[x)-g[y)\^dvdx, 

Jo Jo 

and then 

||IE(^,|-Fo)||'<^2* [' Ii\.^y\<2->'M^) - 9{y)\^dydx 

, Jo Jo 



k=l 



6 Appendix 

6.1 Maximal inequalities 

Following the idea of proof of the maximal inequality given in Proposition 5 of Merlevede and Peligrad 
(2010), we shall prove the following result: 

Proposition 14 Let (li)i<i<2'- be real random variables where r is a positive integer. Assume that 
the random variables are adapted to an increasing filtration {Gi)i<i<2'- ■ Let (^i)i<i<2'- be real random 
variables adapted to {Gi)i<i<2r and such that for every i, E(Zi|fJj_i) ~ a.s. Let S'„ = Yi + • • • + 1^ 
and Tn = Zi + ■ ■ ■ + Zn- Let ip be a nondecreasing, non negative, convex and even function. Then for 
any positive real x, any real p> 1 and any integer u G [0, r — 1], the following inequality holds: 

1 1 

P(^max^ \S, ~ n > 4x) < -^E(^(^2. - T^O) + - ^ E(|y,|l{|y.i>./2.}) 

+ ^(E( E msik+i)2^ - s,^.\g,^.)r^ 



Remark 15 When the sequence {Yn)nez is stationary as well as the filtration {Qn)ne'L, the inequality 
has the following form: 

P( max |^,-T,| >4a:) < ^E(^(52.-T2.)) + -E(|Yi|l{|y,l>,/2.}) 
+ ^2lg^||E(52nao)||,)'. 

l—U 

Notice now that for any integer n € [2'^"-'^, 2^^), where r is a positive integer, E((^(52^ — T2^)) < 
E(i^(S'fc — Tfc)). In addition, due to the subadditivity of the sequence (||E(S'„|t?o)||p)„>i : 
we have that 

k 

2'=||E(52^|tyo)||p<25]||E(5,|go)||p, 
i=i 

implying that for any integer n G [2*""^, 2*"), where r is a positive integer, and any integer u S [0, r — 1], 

r — 1 2^^^ 

j:^\ms2AQo)\\,<2Y.mis,\so)\i E ^luk^^ 

i=u j=l i:2»>jV2" 

and then that 

r-1 , „9-H/„ , 2"-l 



j:^ms2Ago)\\,<^^^^^{^;^ E \msk\go)\\r>+ E 

i—u k—1 k—2^ 

It remains to apply Lemma [T7] below to obtain the following corollary: 



13 



Corollary 16 Let {Yi)i^z be a stationary sequence of real random variables. Assume that the random 
variables are adapted to an increasing and stationary filtration {Gi)i<£z- Let {Zi)i^z be a sequence of real 
random variables adapted to {Gi)ii=z cmd such that for all i, ¥,{Zi\Qi^i) ~ a.s. Let Sn =Yi + --- + Yn 
and Tn = Zi + • • • + Z„ . Let tp be a nondecreasing, non negative, convex and even function. Then 
for any positive real x, any positive integer n, any real p > 1 and any real a G [0, 1], the following 
inequality holds: 

1 2n 

P( max 1^, ~ T,\ > Ax) < —— max E{ip{Sk - Tu)) + — E(|yi |l||y,|>,/„=}) 

l<i<n ip[x) n<k<2n X " ' 

Cpnf ^ \\E{Sk\go)\\p\P 



xP \ ^ 



xP \ ^ yfci+i/p 

fc=[no] + l 

where Cp is a positive constant depending only on p. 
Proof of Proposition [141 

Using the fact that E(r„ - Tk\gk) = for < fc < n, we get, for any m € [0, 2'' - 1], that 

So, 

m£,x\S,-T,\< max |E(5'2.- - T2He2.--m)| + max \EiS2- - S2--rn\G2^-rn)\ ■ (33) 
l<i<2'- 0<m<2'--l 0<m<2'--l 

Smce (E(52r — T2r\Qu)u>i is a martingale, we shall use Doob's maximal inequality (see Theorem 2.1 
in Hall and Heyde, 1980) to deal with the first term in the right hand side of ([55]). Hence, since (p is 
a nondecreasing, non negative, convex and even function, we get that 

P( max |E(52. - TaH^/a^-™)! > x) < ^E((p(^2^ - T2,-)) . (34) 

^0<m<2'^-l 'P[X) 



— 6i(m)2*, where bi{m) = or bi{m) = 1 . 



Write now m in basis 2 as follows 

r-l 

m 

Set mi = bi{m)2'^. With this notation mg = m. Let < u < r — 1 and write that 

|E(^2'- - ^2--™ 1^2--™) I < |E(^2'--™„ - ^2'--m|^2'--m)| + |E(5'2.- - ^z--™,, 1^2'-. 

Notice first that 

P( max |E(52.-™„ - 52._™|e2.--m)| > 2x) 

^0<m<2'--l ^ " I /I / 



2' -m,, 

<P( max y |E(rj|g2'--m)| > 2a 

^0<m<2'--l ^ I V Ji 
~ ^ j=2'^-jn+l 



Therefore since |m — m„| < 2", 



»( max |E(52._™„ - ^2'--™|e2--m)| > 2x) 

0<m<2^ — 1 

<P(^^max_^ y E{\Yj\l^\Y,\>x/2^'}\G2^-m)>x) 

- - j=2'--m+l 
2'" 

< P(^^max_^y E(|y,|l{|y^.|>,/2.}|g2'--m) > x) . 
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Noticing then that ( J2^^-^^^{\Yj\l[^Yj\>x/2'^}\Gk))i.^-^ is a martingale, Doob's maximal inequality im- 
plies that 

2'- 

P( max |E(S'2'- \Q2--m)\>'2.x) < X ^ ^E(|r^|l||y^|>^/2-}) , (35) 

^'"^ i=l 

On the other hand, following the proof of the proposition 5 in Merlevede and Peligrad (2010), for any 
p > 1, we get that 



0<m< 



max |E(^2--^2-mja2--m)r < Va;-p max |E(A,.i|^2--m)r , (36) 

m<2^ — 1 ^ — ^ 0<m<2^ — 1 

l—u 

where 

A/ - 

Er-i 
l=u 



^"^^ 1/p 

A/ = — -^^ — with a; = ( ^ l|E(S'(fe+i)2i - S'fe2'|5fe20llp) 



fc=i 
and 

A,/ = max |E(S'2r_(j,_i)2! - <S'2'--/c2' l^2'--fe20l • 

l<fc<2'-',*: odd ^ ' 

Notice now that by Jensen's inequality, |E(Ar,i|t/2'--m)|^ < E(yl^j|t/2'--m)- Hence starting from (|36 
we get that for any p > 1 , 

P( max |E(52. - 52.-™je2--m)| > 

r-1 

< Pf 



■VA,-^ max nKi\Q2r^^)>x^). 

' 0<m<2'--l ' ^ 

Next, since (Ei{A^^ j\Qk))k>i is a martingale, Doob's maximal inequality entails that 

r-l 

P( max |E(52. - 52.-,„jg2.--m)| > x) < x'^Y \]-'P¥.{AIi) . 



l—u 

Taking into account the fact that that E(A^;) < together with the definition of ai and A;, we then 
derive that for any p > 1, 

P( max |E(52.- - S2r-mAQ2r-,n)\ > x) 

^^^''(E( E l|E(%+i)2'-^fe2nefe20ll^) y. (37) 

/— u k—1 

Starting from p3|) and considering the bounds (p4)) . ((35|) and p7|) . the proposition follows. O 
6.2 Technical results 

Lemma 17 In the context of stationary sequences, for every 7 > 0, n > 1 and p > 1, 

1 



MSk)\\p<c^ J2 ^l|Eo(^/c)||p , 

where c^, = 3 x 22^+^(2^+1 + 1). 



/c>n+l 
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Proof. We consider k > n and start from the inequality 

\MSn)\ < |IEo(^fe+n)| + \Eo{Sk+n - 5„)| ■ 

Then, by the properties of conditional expectation and stationarity 

\\MSn)\\p < \\Eo{Sk+n)\\p + mo{Sk)\\p . 

So, for any n > 1 

^ ^ 2n 2n ^ 

-||Eo(5„)||p-^||Eo(5„)||p( E l)<2^+i||Eo(5„)||p ^ ^ 

k—n-\-l k—n-\-l 
2n ^ 2n 

^2^^' E ^l|IEo(^fc+„)||p + 2^+i ^ __||Eo(5,)||p 

fc— n+1 fc— n+1 

271 ^ 2n 

fc=ji+l ^ k=n+l 

We easily derive 

1 °° 1 

-||Eo(5„)||p < 2''+i(2^+i + 1) ^ _||Eo(^OIIp ■ (38) 

By writing now 

|]Eo(5fc)| < |Eo(^fc+„)| + \MSk+n - Sk)\ , 

by stationarity we obtain 

max ||Eo(5fc)||p < max ||Eo(5fc)||p+ ||Eo(5„)||p < 3 max ||Eo(5fc)||p , 

l<k<n n<k<2n n<k<2n 



and the result follows by the inequality (1381) applied for each k, n < k < 2n. 

The following lemma is concerned with a property of subadditive functions. 
Lemma 18 Assume that I]5^]^||Eo(S'„)||n~^/^ < oo. Then, for a universal constant c and integer a 



1 ^ ||Eo(5„fc)|| ^ ^ ||Eo(50|| 

^ fc=l l>a 



Proof. The proof of this Lemma is an easy consequence of Lemmas 3.1-3.3 and the proof of 
Lemma 3.4 in Peligrad and Utev (2006) and the fact that ||Eo(S'„)|| is a subadditive sequence. 

Next result we formulate is Corollary 4.2 in Cuny (2009 a). 

Proposition 19 Assume {Xn)n<£Z is a stationary sequence of square integrahle random variables and 
{bn)n>i o, positive nondecreasing slowly varying sequence. Assume 

E^n||5'„|p 
^ < oo . 

n>l 

Then 

Sn „ 

—j= a.s. 

where 6; := ELil^^fc)"^- 
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We give here a generalized Toeplitz lemma, which is Lemma 5 in M. Peligrad and C. Peligrad 
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